Project Hedron is focused on the exploration of abstracting interactions for virtual and immersive experiences. Hedron-16 is a virtual reality headset that is the tool for exploring humming as a new type of interaction for immersive environments.
check out the project on Github:https://github.com/clairewcheng/Project-Hedron/blob/master/README.md
Now that our machines have the power to understand audio input, it’s super interesting to ask ourselves, will we communicate with machines the same way as we do with other people? Or will develop other ways of communicating with our computers? Natural language? Abbreviated speech? Can we be sarcastic with our computers like Tony Stark?
Hedron-16 just begins to scratch the surface of this pretty complex question and it takes the approach of making something that is fun and explorative rather than directed and stuffy.
The original plan was to rig a classical user interface with the humming analysis or to gamify the interaction, but in the spirit of the research aspect of this project, I decided to make a “virtual ball pit” where interaction is pretty limited. Don’t be fooled though, playing around with it with my friends I found that people will find all sorts of funny and unexpected ways to make nonsensical noises to control objects in this virtual environment. To explain simply what my code does, I’ve got lots of objects handing out in a scene and when the user looks in the direction of one of these objects and hums, the object will get a force applied to it. I calculated this force to be proportional to both volume and pitch of the hum.
Inside the "ball pit" users can explore and play with humming as a means of interacting with objects in the environment.
